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IlBSTIt&CT 

This discussion draft of a conceptual frasairoric for 
Bonitcrlng children's services vas prepared by Peat» Haririclc and Co. 
f^r the Children's Services Ronltotlng Transfer Consortiua (CFHCSK 
an oraanizatlon spanning five states; California, Hichigan, 
Pennsylvtinla, Texast and- west Virginia. The prisacy purpose of this 
coi^ceptual f rasevork vas to define the scope of activities 
appropriate to the consortlur, Follovi^ng the first section's brief 
Introluctorv overview or CFRCS.'s purpose, section tvo briefly 
discussed the social services enrlronsent in vhlch sonitoring takes 
Place in teres of state differences in scope of approach, tersinology 
used, and organisation of sonitoring and related activities. The ^ 
thirl secjblon sets forth a lefinltlon of soaltorlng as a sanagesent 
control process. The definition clarifies vhat is included. in 
sonitoring, sets boundaries to exclude certain activities, , and 
sugcrests looking at nonltorlng as a process that seeks to increase 
both prDgras quality and sanagesent efficiency on an ongoing basis, k 
aeneral sonitoring classification f rasevork, reflecting what is 
happening in day care sonitoring in the five consortiua states, is 
presented in section four. The final section discusses issues related 
to the extension of the sonitoring concepts to other children's 
services. (Author/RP) 
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IMT RODUCTION ^ ^ 

• Vlut Is nonitorljag? 

^ . Caa a daflttltion of monitoring in children's services 
be agreed up<m in viev of vi4e variations in practice? 

/ . * ' ' ■ " 

. Whay perspective should the five-^tate Children's 

Services Transfer Consortium take of monitoring? 

«. ft 

These ^hree questions arose early in planning the Children's Services Mon- 
itoring Transfer Consortium. Because of wide variations in the way that 
monitoring services is viewed in the five Consortium states, as well as - 
in other states » we rec6mmend the need fot clarification of the term ^ 
••monitoring". As the scope of the Consortium is first vipon,day care, most 
of the Illustrative material In this paper is based upoi day care. , This 
conceptual framework was developed by Pea£ Harwlck with input ICrom discussion 
meetings of the Consortium in February 1981. It defines the scope of 
activities until at least October 1981 when the Consortium will reconsider 
it. / 

With Department of Health and Human Services* encouragement and financings r 

^ stat'iS^of California, Michigan, Pennsylvajiia, Texas, and Wept Virginia 
formed a Coneortlum in October 1980 to transfer exemplary components of 
Chlld:«i's Services Monitoring systems among themselves. While day care 
was seen as the primary focus of attention, the t];ansfe|: methodology is 
believed to nave considerable potential f 6r ^other children's service areas 
-in which these states and olshers are involved; As;* lead state, Pennsylvania 
applied for and received an HftS grant and has contracted with Peat Marwlck 
for staff services to the Consortium. ^ 

The primary purpose of this conceptual framework of monitoring is to decine ^ 
the scope of activities appropriate to the Consortium. As a working docxunent, 
the framework serves as one criterion for asseselng the transferability of 
monitoring components from one ^stmte ta another. The framework may also 
suggest^o the states areas for improvement and expansion of their monitoring 
role. li addition, because of the lack ot agreement about monitoring in the 
social services field, %hm framework promdtes. further thinking about the 
application of management concepts of monitoring. 

This discussion dra^t of a'c9nceptual framework for monitoring was prepared 
for the Consortium b^ Peat Marwlck base^ on: * 

. a revley of the literature; 

. an «attly«l* of th« practices of the five states In * 
the Coa&ortium: and 

• the initial rcuiponses of the Consortium members aad 
othars to earlier drafts* 
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CiHAsaucnm of the pa? ee 

Thl« paper ij««a' llluscratipns primarily from the day care field. The next 
aection diacuaaaa b*iafly the iodal aervices environment In which man- 
Itoring takaa placa» in terma of atate dlfferencea in acope of approach, 
tandaology uaed, and qrganlaatlon of monitoring and related activities. 

TiM^third aaetlon aeta forth a definition of monitoxrlng aa a management 
concept. 

The fourth aectlon preaenta a generic monit:orlng 'classification framework 
vl(th application to the day care field. 

The final aectlon diodUaaea laauea in extending the monitoring concepts to 
other chlldrena* ae;c^cea. 

EMVIRDHMENTAL CONSIDERATIONS ' 

Monitoring of the aoclal aervioBa la conducted within an established en-- 
viroineut of some puhlic agency dealing with independent organizations that 
are being monitor^. Theae monitored organizationa may be operated under 
governmental, voluntary, -or proprietary auaplcea. The environment is 
dlacuaaed ia this aectlon aa dlfferencea in: 

. scope of monitoring; 
• terminology ; * and^ 
^ • organlzj^tlon,. 

Dlfferencea in Scope of Mbn^oring * 

The range of actlvltle/ related to day care that may be considered to be 
monitoring in this project varlea conaiderably from atate to state. Typ-^ 
« Ically, however, there are two levexa of'^day care monitoring in which 
atatea jare Involved: 1) monitoring to ensure compliance with state '^licens- 
ing atatutea which apply to all providers and 2) monitoring to ensure 
compliance with departmental regulationa which apply onlr to publicly funded 
^providers. In the latter caae, the regulationa uaually relate to program 
and contracting requirementa which are over and above the "floor" provided 
by the llcanaing atandarda. Aa a aubaequent section of' this paper describes » 
however, the terms uaed for theae two levels are not consistent acroas atates* 

A fev states limit their monitoring of non-pxiblicly funded providers to 
basic requlrementa concerning the health and safety of young children. 
Thla type of monitoring involvea a state. principally aa regulator , with 
reaponaibility for aetting standarda and enforcing compliance. ^ 

Other atatea view their role more broadly by taking a further step to assist 
those day care'provldera who do not meet thfe at^^^^darda at either the appli- 
cation point or at later inspection visits to ^me into compliance. This 
technical aaaiatance la Ip tended to encourage the general improvement of 
- day care in the -state, A>fiAther diatinctioA concerning this type of 

\ -2- ' \ 
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as.^istahce can be made between states that provide remedial assistance only 
to licensed providers who are not in ongping compliance and states that 
offer consxilning services to all providers in advance of the application 
for a license* 

A slightly different e3cpansion in the scope of state involvement occurs 
when a state determines that it has a role in strengthening child develop- 
ment programs beyond the minimum level of its licensing standards. 

The term '•monitoring** has been used by states that are characterized by 
each of these widely varying approaches, but the work has clearly different 
meanings 'in each case. These differences in scope have Important implications 
for the feasibility of transferring procedures or other technology from a 
state that haa one scope to a state with ^ ar^re or less restricted scope. 
For example, a performance appraisal systejn for day care monitors could 
include very different procedures, standards, And measures depending on the 
role of the monitor. 

Our conceptui£l^ framework needs to accomodate such differences in scope so 
t hat judgements can be made about the relevance of a techilology for other 
state systems . 

Differences in Terminology 

Wide differences exist in the terms that states apply to their monitoring 
activities* The term "monitoring" itself may be more or less strictly 
construed to apply to the supervision phase of the licensing process, the 
coiatract compliance prpcess, technical assistance to providers, or other 
activities such as methods used to manage state resources for monitoring. 
In some* states, the term monitoring is never used even though activities 
may be the same as in another state yhere it is. The list 'of terms used 
by states to describe their activities related to oversight of day care is 
a lepgth/one and includes such terms as: 

licensing; 
registration:;^ 
approval; ^ 
« reg>xlation; 

. e8tabllshxnent-.of (recotamended guidelines; 

♦ technical assisti^ce; 

. training; 

. corrective action; 

contracting; 
. reporting; 
. auditing; and 

evaluation • 

Not only are different terms used to describe different activities of the 
states but, in some cases, the same term is used in different states for 
different activities. For example, in Texas the monitoring portion of 
licensing refers to the Inspection of day care facilities to assure that 



basic safety, health, and sanitation standards are met. In Michigan, the 
monitoring portion of licensing refers in part to 'a revi^ that encom- 
passes not only health and safety but aIso child development programs 
that, are offered, parent involvexnent, aod staff skills and credentials. 

Not only are the terms used by the states different, but they are easily 
changed. In many cases such terms as licensing, registration, auditing, 
and monitoring are embodied in state statutes and administrative regulations 
that govern day care. To attempt a coinmon sec of definitions could lead 
to ev€fli greater confusion for those who are most responsible for creating 
a system of quality day care-^the providers. Thus, a conceptual framework 
must develop common, descriptors in such a way that both general features 
of day care "monitoring" systems and specific features of each state's day 
care "n>onil:oring" system are appropriately linked in a way that allows a 
translation, or "crosswalk," of particular terms . 

Differences in Organization 

The organization o! monitoring at the state level is another factor that is 
a source of potential difficulty in transferring components of a monitoring 
system from one St. ce to another. In some states the monitoring function 
Is split among several state units; in other states it is consolidated- under 
a single unit. The most frequently observed division of responsibility for 
monitoring is the delegation of licensing review functions to one unit and 
the delegation of monitoring of federally funded day care to another unit. 
In some states, responsibility for monitoring contract compliance with pub- 
licly funded day care contracts is handled by yet a third unit. Sometimes 
these different units are within the same division or department but they 
may also be organized as parallel divisions* 

Where these types of splits occur, there are frequently very different pro- 
cedures and approaches for monitoring among the several units, with some 
units adopting a regulatory and enforcement approach (e.g», those involved, 
in licensing) while others u3e a consultative approach to service providers. 
This could be reletrant to the Consortium ^because it could lead to diffi- 
culties in the .transfer to monitoring system components. Fcr example, It 
matters greatly whether a component of contract monitoring procedures is 
performed in a transferring state (which divides its responsibilities) by 
accounting technicians or auditors but must be adapted for a receiving state 
(with consolidated responsibilities) to be usable by staff with social work 
backgrounds • ^ 

Thus, our conceptual framework must deal with functions to be performed 
♦ without reference to variations in state orj2;anizatloTial patterns . 

Other Differences 

Another issue arises in Che legal basis for monitoring activities. In all 
states, licensing standards t^at apply to all providers regardless of 
funding are specified in statute; in some states, additional "standards" 
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or req\iirements are applied to publicly funded day care through the ad- 
ministrative regulatory process • While the process for changing require- 
ments that apply to publicly funded d4y care may be time-consuming, it 
may be e^ier to transfer components that impact that process than tho 
which require changing licensing statutes— a most difficult task in the 
ci^rreat political atmosphere of de-regulation, 

A different set of concerns revolves around the fact that states are subject 
to differing political, fiscal, and social forces that can have a significant 
impact on the direction in which their monitoring systems will change over 
Che next few years. In particular, funding may become more limited as many 
states try to reduce budgets in response to taxpayer pressures and inflation. 
Some states may re&pond by finding new ways of monitoring that do not involve 
the levels of staff that are currently employed in monitoring. This kind of 
change could have major effects on the success of transfers of components 
among states. 

It will be necessary for each state to consider not only how particular ap- 
proaches used by other states could fit into its own current monitoring 
systest, but also whether a current system is likely to change before, a 
transfer can have value. 

MONITORING DSriNED AS A MANAGEMENT TSCHNIQUS 

In this paper ^ monitoring is delined as: 

the management process- of reviewing and controlling the 
delivery of program services on an ongoing basis, accord- 
ing to predetermined criteria, wit)i the intentidn of taking 
corrective action to assure and increase both program 
quality and management efficiency, 

'^Management Irocess" and "Ongoing Basis" 

Several key phrases in the definition are highlighted to clarify the use- , 
fulness of the definition. The first of these are "management process" 
and "ongoing basis" which emphasize the continuing and dynamic aspects of 
monitoring an^ help to distinguish monitoring from program evaluation. Moni- 
toring actively seeks to intervene in ongoing systems op a regular, periodic 
baMs for the purpose of making changes and impro/ements This intervention 
in an ongoing system is presented graphically in Exhibit I, in comparision 
to program evaluatica. 

Thus, monitoring may be viewed separately from the service delivery system 
being monitored. In general terms, the monitoring process consists o^: 

, Setting criteria (e.g., standards or administrative 
requirements) ; 
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Conducting the analysis; 



• Reviewing; and 

• Reiterating this process, 

MDxiitorlng is linked to the continuous, ongoing, changing activities of the 
service delivery system being monitored by performing the following functions s 

• agreeing on criteria; 

. . assessing conformance; 
w appraising feedback; and 

• taking corrective action. 

By comparison, in a general sense as depleted in Exhibit 1, program evalu- 
ation does not intervene in the system except to clarify the goals and 
objectives against which activities wlll^be appraised. Thus, program evalu- 
ation first helps managers of service delivery to clarify goals and objectives 
of services. At some defined subsequent time, the program evaluator gathers 
data to test whether the delivery system is producing the desired results. 
(Prog;catt evaluation is a very broad topic whl'ch this paper does not attempt 
to discuss; this presentation is only to differentiate between monitoring 
and evaluation at a generalized level.) 

Another way of viewing monitoring as a management process is to look at it 
in terms of system elements and in relation to program «ivaluationr-as de- 
picted in Exhibit 2. In that presentation, the service delivery system is 
broken into the following system elements: ^ 

. Resource inputs; 

. Production or service process; 

Product or service outputs; and 
. Outcomes /go^ achievement. 

Within, these four elements, monitoring is viewed as the ongbing analysis 
of inputs, , process, and outputs of the system. This is compared to program 
evaluation which looks at outcomes as compared to inputs, process, and 
outputs. 

Another intferesting perspective suggested in Exhibit 2 is that the analysis 
of inputs and process is best conceived of as quality assessment. For ex- 
ample, the ratio of number of staff to children is best viewed as a quality 
indicator m it can be compared with national or state standards. However, 
this standard does not measure output nor. except in limited instances, ts 
it linked empirically to outcome. In this example, adequate staff/child 
ratios do not necessarily ensure the outcome of positive child development 
in the childrea cared for. 
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EXHIBIT 2 

MONITORING AS COMPARED TO PROGRAM EVALUATION 
IN TERMS OF SYSTEM ELEMENTS 
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Another inanagensent consideration is in the analytic focus which relates 
outputs and inputs to develop efficiency measures* For example, the 
cumulative total number of days of care provided by all staff provides 
an efficiency measure but is not empirically linked to outcome- In our 
-Ififinition, Che efficiency measuie is generally the level at which monitoring 
ope^rates. 

On the other hand, the compacision of inputs and processes to outcomes which 
comprises outcome analysis is generally the analytic level which evalua- 
tion operates. For example, Pennsylvania uses an instrument for monitoring 
all day care center providers that includes such items as: the existence 
and type of child development activities provided, the physical condition 
and safety of the provider center or home, and the quality of financial and 
other record keeping. These iten:s help to focus on the qualicy, efficiency, 
and regulatory compliance of the day care services provided. Clearly, the 
monitor who performs a review using the questionnaire is also concerned that 
children's development and health are being enhai^xed and that parents are 
satisfied with the day care services. However, the monitor's role stops 
short of attempting to measure the extent of parent satisfaction, the pro- 
gram's contribution to the children's health, or the degree of child devalop-* 
ment that has occurred. The measurement of these factors and their relation- 
ship to the resources used and s^irvices provided w^uld fall within the realm 
of program evaluation , 

"Reviewing and Controlling" 

Another key phrase in the definition is "reviewing and controlling." This 
phrase highlights the management control focus of monitoring. Monitoring 
does ^ot include the organisation of service delivery, the installation 

^nagement systems to support service delivery (e.g., the development and 
introduction of an accounting system for day care providers), or the selection 
of personnel to provide the services. All of these aspects of management 
may be tested by the monitor; however, the objective of monitoring is to 
assess whether these management systems are functioning well or poorly ac- 
cording to predetermined criteria and to take steps to correct any defi- 
ciencies that may be observed. 

"Program Quality" and "Management Efficiency^ ' 

The third key phrase is "assuring and increasing program quality and manage- 
ment efficiency." "Program quality" is defined at whatever level a state 
finds acceptable and has incorporated into its licensing^standards and its 
regulations. This term could include basic health and safety or enrich- 
ment or good managament by the provider which leads to higher quality 
services to children. The monitoring role from the Consortium's perspective 
is not simply one of enforcement of standards as would be true in the li- 
censing function but encompasses active support or improvement in the systems 
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(providers) that are monitored. The monitor plays a supportive role alia 
works with the llirvice providers to develop a strong service delievery 
system. Further, the emphasis is on the quality of the services provided 
and Che resulting benefits to the clients that served. Both quality and 
efficiency are monitoring concerns, 

^'Predetermined Criteria^* 

The final key phrase is "prevletermined criteria." The control criteria 
Chat are applied- must be estacll^Hed as the first step in the monitoring 
process, and these criteria muse have the acceptance (whether voluncarily 
or required by law) of the service trcvider. Ideally, service providers 
will have been involved in their developn«nt and implementation, and the 
criteria will reflect the most curTen^ accepted research and thinking in 
the particular field of service. Tiii^ilLy, the criteria should impose the 
least constraints on the service pro^rider consistent with the objective 
of meeting designated levels and quality of services provided. V^le 
equity may not require that the same rtqxiirements be used for every type of 
service provider, it is critical that whatever requirements are applied are 
known by the service provider before monitoring begins. 

la s'y™^ry ., monitoring is a management control process. This definition 
clarifies what is included in monitoring a\\d sets boundari-^s to exclude 
certain activities. Monitoring at l.ts hcst is a forward-looking and posi- 
tive process that seeks to increase both program quality and management 
efficiency on an ongoing basis. 

GENERAL CLASSIFICATION FRAMEWORK 

Having defined monitoring for the purposes of this project, it is useful to 
consider the many ways in which monitoring is accomplished. The identifica- 
tion and enumeration of the particular functions that are included in mon- 
itoring is a method for developing an operational definition of monitoring 
that can serve as a b*.8is f r describing and comparing various monitoring 
systems. la this section, the emphasis is on an illustration of monitoring 
of day care services; however, the classification framework presented should 
be of value in considering any kind of regulatory activity carried out by ^ 
public agencies, especially with respect to other childrens' services* It 
is important to note that the claaaif ication framework reflects what is 
happening in day care monitoring in the five Consortium states and others 
and does not represent a recommendation for the way monitoring should be 
structured* 

The generic classification framework r^^xsented in this section has three 
major components: 

. goals of monitoring; 

, generic monitoring Actions; and 

. examples of st^-^te terms i:elat«^d to generic functions. 



Each of these is described ^Xi greater detail below. Exhibit 3 provides a 
tabular ae^lctlon of the framework. 

Goals of Monitoring 

The goals to be achieved through a state's monitoring efforts are typically 
embodied (though not always explicitly) in tha statutes or regulations con- 
cerning day c^re. In general, four laain goals zaay be identified: 

. protecting the health and safety of young children; 
. promoting positive child development; 

assuring compliance with contracts; and 
. managing resources efficiently and effectively. 

These goals provide the ixiltial basis for categorizing aionitoring activities; 
and they are listed in Column 1 of E^dtiblt 3« 

These goals are intended to be as comprehensive as possible in specifying 
the purposes of a monitoring system with regard to day care. They reflect 
both the positive focus of monitoring vrtiich is to improve services as well 
AS the issurance or compliance focus whlqh is regulatory in nature. 

Generic Monitoring Functions 

The goals may be further divided into the generic functions that are per-- 
formed to achieve goals (Exhibit 3, Column 2). The mpi^ltorlng functions 
listed in Exhibit 3 are also intended to represent the set of general tasks 
that are performed as part of a monitoring effort. These functions en- 
compass enforcement activities, assistance to service providers, and ac- 
tivities directed at improving the general management of the overall day 
care system. 

It is important to recognize three characteristics of ^he generic monitoring 
functions. First , not all of the functions listed may need to be performed 
by a State nor are they all performed by every state. Many of the functions 
are performed by the sta^e but the precise scope of state activity is deter- 
mined by general political environment regarding state involvement in regu- 
lation. Further, even If a state hai. an interest in assuring that e parti- 
cular function is perfrrmed, it is often possible to encourage parents, 
third parties, (e.g., accounting firms for financial and compliance audits), 
or even the providers themselves to perform the functions with state assistance 
supervision* 

Second , a state's perform^mce of a function is almost always authorized and 
defined by regulations, and sometimes required by law. The extent and 
quality of the regulations vary widely from state to state as may the method- 
ology of enforcement and the range of state options to remedy unsatisfactory 
provider performance. Some states ha\'e determined that a simple checklist 
approach to compliance with requlr^ents is suitable, while in others com-» 
pliance Js ascertained by the tis© of higfily developed measures and standards. 



EXHIBIT 3 



GENERIC CLASSIFICATION FRAMEWORK FOR DAY CARE MONITORING ACTIVITIES* 

X 

Goals of Monitoring ^ Generic Monitoring Functions Examples of States' Terms 



Protecting the health 
and safety of young 
children 



Promoting ^positive 
child development 



JPerfonn health, sanitation, fire and safety 

Inspections 
Review health and linmunlzatlon records of 

children and staf^ 
Check staff knowledge and skills with respect 

to health and fire safety procedures 
Check records for aval lability of emergency 

phone numbers and health precautions 
Check adequac]{^and nutritive content of meals 
Check safety of vehicles and transportation 

procedures . 
Enforce child abuse prohll^lons 
Develop corrective action plans for deficiencies 

Check provision of program of activities 
Check provision of toys and activities 
equipment 

Verify levels of staff Interaction with 
children 

Check levels of parental involvercnt 

Ensure staff qualifications and capabilities 

Encourage impr&vements in service (e*g», 

provide information, training, technical 

assistance) 
Check staff/child t*»tlo and group size 
Verify existence of plans for each child 
Check for mainstreaming and special activities 

to include handicapped children in program 
Develop corrective action plans for deficiencies 



Licensing Supervision 
Registration 
Approval 
Regulation 
Corrective Action 
Technical Assistance 
Delegation/Coordination (e.g«, of 
all agencies involved in licensing) 



*List not intended to he comprehensive. 



Quality Assessment 
Regulation 

Licensing Supervision 
Registration 
Certification 
Technical Assistance 
Training Providers 
Corrective Action 

State Particlpatihn in Public Groups 
(e.g., professional associations, 
local community groups) to Promote 
Child Development 

Public Education 

Interagency Cooperation 

Program Enrichment 

Program Development 



GENERIC CLASSIFICATION 



fIramewoi 



JEXHIBIT 3 



RK FOR DAY CARE MONITORING ACTIVITIES (continued) 



Goals of Monitoring 



Assuring complience 
with contracts* 



Cenerlc Monitoring Functions 



Verify delivery of contracted levels of 

service (e,g,> enrollments, attendance) 
Verify coaipriance with other terms of 

contracts (e.g., non-dl8crlr,lnatlon, 

minimum wage) 
Check quality of statistic:;! and financial 

Information and conduct fiscal audit 
Develop corrective action plans 
Check detenalnatlon of eligibility for 

children 



Examples of States' Terms 



Contracting 
Reporting 

Billing and Paying 

Auditing (fiscal and program^ 

Periodic Reviews of Contract Performance 

Provider Selection 

Admlnls .ration/Judicial Review Procedure 
Contract Compliance 



I 



Manai^ing resources 
efficiently and 
eircectlvely 



Short-r**nge and long-range planning 
Allocating resources 
Recruiting and developing staff 
Developing new provider resources 
Evaluating day care sy^l^m 
Developing procedures and systems 
Developing and mon\toring policy 



Legislation 

Regulation and Policy Development 
Planning 

Budgeting and Financial Control 
Personnel Management '^'"^ 
Funds Development (e.g«. Titles XIX and XX 
Technical Assistance In Managing Programs 
Facilities Development 
Systems Development 
Program Research and Evaluation 
Staff Development 

Resource Development (e.g., provider 
recriiitment) 
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Tlilxd , for purposes of this conceptual fraiaework the functions are intended 
to b€ general rather than specific* It would be possible to subdivide each 
function further into particular mathods of performing the function* For 
example, the function *'check provision of program of activities'* might be 
broken down into the following subf unctions: 

. verity the existence of a program plan;/ 

• check the plan to determine what activities are 
scheduled at the time of the on^^ite review; 

^ determine whether the activities are age-ar^proprlate; and 

. verify that the scheduled activities are being performed. 

In defining general mo&ltorin& functions* we avoided this level of detail 
in the framework because it Is possible to utilize a variety of approaches. 
For example^ a less active approach than afadve to this sample function could 
Include as alternate subf unctions f 

, verify that the provider gives each parent a description 
of the program offere4 )>7 the provider; or 

, investigate only con^Jlaints received from t'arenta that 
the provider is not adhering tu the general program 
promised « 

Examples of State Terms 

Column 3 of Exhibit 3 lists some of the designations given hy states to 
activities that incorporate the generic functions and are focused on 
achieving the various goals; These provide a link between the goals, the 
generic functions, and the terminology used by states for monitoring ac- 
tivities* There is not a one-to-^ue correspondence between any .single 
term and a related function or goal« Instead^, soma terms are applied to 
several goals acd may apply to various combinations of functions. For 
example 9 in certain stages registration of family day care homes may include 
several of the generic functions listed under both ^'protecting the health 
and safety of young children" and "promoting child development," In other 
states t the term "registration" would refer oni^ tr- the assuring compliance 
related to tie generic **health and safety" functions while program enrich- 
ment would be used to describe generic functions relate ' to child develop-- 
ment« 

The (terms listed are some of the most frequently used terms in the Consor- 
tium! The list, could be expanded substantially if every state terminology 
were included. If the classification framework is well constructed, however, 
any^^Mutltional terms should be readily subsumed under one of the four goals 
or related sets of generic functions. 
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Ig summary » by specifying ai|tivitles that are actually being carried out 
under the term "monitoring," we have. a mechanism for clarifying differences 
in terminology among states and for comparing the scope of monitoring ac- 
tivities. Further, the classification framework should have heuristic value 
in encouraging states to view their particular monitoring system in the 
context of a complete listing of many of the functions that monitoring could 
conceptually include • Finally, identifying these activities gives a practical 
interpretation of the conceptual boundaries of monitoring as defined at the 
beginning of this paper • 

In the process of transferring components within the Consortium, we will 
attempt to resolve the questions raised by this pager. Howe^^er, this con- 
ceptual framework provides only a basic structure for resolving the issues. 
The insight and experience of state administrators who have monitoring re- 
sponsibilities will be an essential additional requirement in the use of the 
conceptual framework for achieving useful transfers of moDitoring components. 

EX TENDING MONITORING CONCEPTS TO OTHER CHILDREN SERVICES 

The Consortium states and other interested parties have suggested that 
foster care, day treat^pnt, special needs programs, and health service 
linkages through the day care dellveiry system may be children's services 
where similar monitoring 'concepts could be applied. lu considering the 
idea of expanding from day care to other children's services, a number of 
questions naturally arise. The following questions should be studied 
carefully to take into account differences among services that may affect 
the broader application of monitoring concepts being developed by the 
Consortium: 

1. Is the aj;^ency^_setting the same for monitoring day 
cafe and the other children's service (s) beins^ 
considered ? 

Generally, the same agency~a department of public 
welfare or human services — provides the setting 
for monitoring. However, day care is usually mon- 
itored in a separate division from such services 
as protective services, hcmemakers, and foster 
family care. 

2. Are the same j^roup of professionals involved ? 

Whil« the chief executive of a department is 
usually the same, professionals with quite dif-- 
ferent backgrounds are involved at lower levels. 
Typically, child development specialists operate 
day care programs while social workers operate 
other children's services. 
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3. Are the s^^ne providers involved? 

Generally, agexicles and individuals that provide 
day care are a different group from those agencies 
that provide such services as residential care, 
foster family care, adoption services or protective 
services. This may mean that providers must be 
reached through different networks than those al- 
ready established through the Consortium. 

4. Are the service delivery processes the same ? 

Major differences are apparent between day care 
which Involves part^^ay responsibility for young 
^ children and such services as foster care which 
Involves 24^hour responsibility or protective 
services irtilcb many times provides services in a 
child's own home. 

5* Are licensing and aonltorln& activities as well 
conceived and structured for the other children 's 
services? 

In general; the decent thrust of improvements in 
day care OKmitorlng has not been m^&tcbed in th£ 
other children's services ^ A recent 4urvey of 25 
state child welfare progrcms revealed an almost 
universal lack of performance standards in the 
social services against which to monitor service 
delivery. The use of the term '^monitoring" in 
social services varied widely from that recognized 
in the management sciences; many states simply say 
that monitoring services is a part of the super** 
visor's ftmction and leave the terms undefined* 

PrellminAry consideratiun of these five questions support the thought 
that significant differences exist Ia the environments within which 
monitoring of day care and of the other children's services functions* 
Thus, subsequent examination of the goals and fxmctions of monitoring in 
the other services needs to take these differences into consideration. 
*» 

On the other hand> the Pennsylvania Department of Public ,Welf are has been 
relatively successful .in developing new^ instruments for monitoring foster 
family carer using the same approach as they do in day care. While there 
has not yet been time for a structured pilo:: test of the instrument, one 
Pennsylvania regional office has applied the approach with a re«*^onahle 
level of satisfaction. 
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Iowa is another State thai had demonstrated a structured approach to 
monitoring their social service programs. The Iowa Department of Social 
Services has developed a '^Planning and Evaluation Service Rtview" process 
which is applied to all Title XX social services. Their service review 
worksheet provides a checklist of elements that? are to be verified through 
inalysis of case records and applications or in interviews with clients. 
The Iowa approach (as well as a planning effort of the Wisconsin Division 
of .Family Services in 1977-78) borrowed heavily from the quality control 
approach which involves independent verification of a sampling of units 
of production (or service).* 

In summary, extending the monitoring concepts of day care to other children's 
services will require careful study primarily because of differences in the 
environments within which services are provided and monitored and because 
of differences in the monitoring errperlence of the other serv-f.ces. The 
Consortium plans to study this issue in Phase II of its project liie, be- 
ginning in November 1981, and welcomes information about, developments, 
comments and questions. 



• 



*Peat, Warwick,' Mitchell & Co,, and Child Welfare League of America: 
Detailed Design of Quality Control of Children's Social Services , prepared 
for Office of Child Development-DHEW Contract No* REW-105-76-11--1, August 
1977 (Unpublished Draft), p. II. 5. 
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CHILDREN!^ SERVICES MONITORING^TRANSFER CONSORtlUM 



!!!l3/HDb C:-* 90-PD- 10005 



June 1981 



CONSORTIUM LAUNCHED 

An ftxdting new venture of five States waj launched in November 1980 to transfer exemplary components of monitor- 
ing of chiiui^n's services. With financing through a grant from ihe Deparimcnt of Health and Human Services, Office 
of Policy Devetopment, a Consortium was formed by: 
|f • CaUfomia Department of Education; 

• Mkfaigan Department of Sodai Services; 

• Pennsytvania Department of Public Welfare; 
« Texas Department df Human Resources; and 

• West Virginia Department pf Welfare. 

Additional States will be invited to participate in the future. The grant has a three-year timeframe, with HHS grant 
financing ol a year-to*year basis. 

Pennsylvania is serving as the lead State,, and Rick Fiene of the Pennsylvania Office of Guldren, Youth and Families 
is Project Direaor. Peat, Marwick, Miafhell & Co. is providing technical assistance and staff services to the Consor- 
tiumr under contract with Pennsylvania. 

Goab and Purpose of the €oiisortium 

The goal of the Consortium is to enhance the capability of the Sutcs to oversee programs for children to assure the 
health and safety of young children as well as the quality oiT programs. The Consortium's mode of operation is to pro- 
vide for Stave-to^State transfer of exemplary and cost-saving monitoring components: practical improvements that?' 
have de«nonstrated their usefulness in helping agencies to man;?ge and oversee service delivery. ^ 

The purpose of the Consortium is to nionitor State-based standards and regulations guiding the provision of services 
for children. Initially the Consortium is focusing on child day care-both in centers and family day care settings-^with 
plans to expand to other children's services. 

MONITORING DEFINED AS A MANAGEMENT TOOL 

Monitoring has been defined by the Consortium as: 

The man0<yemcnt process of ^-^ewing and controlling the delivery of program services on an 
ongoing basis, according to predetermined criteria, with the intention of taking corrective ac- 
tion to assure and increase both program quality and management efficiency. 

Because the Slates use varioiis terms to describe their activities related to oversight of children's services, the following 
are defined as being within the scope of the Consortium: licensing, regulation, approval, establishing regulations or 
guidelines, technical assistance, fraining, corrective action, contracting, reporting, auditing, and evaluation, 

A "Conceptual Framework for Monitoring Children's Services" has been prepared as a working draft and is available 
to States ana interested professionals, upon request. 
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A DEMONSTRATET AJ?PROACH TO STATE-TO-STATL TRANSFER 



The transfer ^spproach being used by the Consortium is based on the ap' . oach developed by the HHS Human Services 
Management Transier Projca. This approach has proven to be an e^f^^ctivc and efficient way to share technology, ex- 
periences, and expertise among States. Exemplary nr...nitoring components within one State will be modified and 
tran.«ferred within ihr Consortium. These components win thex* be ^'packaged*' into more generic pieces which, in 
Phases II and III* can be transferred to States that axe not currently part of the Consortium. The transfers typically in- 
volve assisting the receiving State in pla^^ning, developing workplans, modif>ing, designing, testing, troubleshooting, 
implememmi^afld as^smg the transfer. 



Getting organized in the first phase included convening the Consortium, developing descriptive profiles of each of the 
five Statics' monitoring systems, identifying 22 -xcmplary monitoring components as candidates for transfer, prepar- 
ing the conceptual framework of monitoring, and setung specific objeaivcs for initiating transfers. While each State 
has exchanged information and materials on selected monitoring components to otncr States, the following major 
transfer, have been initiated: 

• Pennsylvania u ^ 'Ifomia - An instrument- "^ased appi oach to monitc ing State day care 
standards for health, safety, and program quality and then linking the data to statistical 
and fiscal data to provide decisionmakers with i>ound objective analyses of programs, 
cost^^benefits, problems, and progress, 

• Caiiforma to Texas - A competitive procurement process for day care and oc*..* 
purchased social scrvii.cs. 

• Michigan to California ana Texas - A licensing enforccme:.. workshop that trains workers in 
the total enforccmcni process from initial conftplaim intake o the gathering of evidence for 
administrative hearings. 

• West Virginia to iMichigan - An enrichr -^at program for fanuly and center day care providers 
ihaf includes monitoring for standards (the program was originally developed under an HHS grant 
to West Virginia). 

• Pconsyivama to Michigan, Texas, and West Virginia - A methodology for developing a **shor: 
form'* indicator checklist for monitoring th^t predicts full compliance with State standards. 
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